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Abstract 

The hierarchy of fermion masses and EW symmetry breaking with- 
out elementary Higgs is studied on the basis of strong gauge field 
distributions governing the EW dynamics. The mechanism of sym- 
metry breaking due to quark bilinears condensation is generalized to 
the case, when higher field correlators are present in the EW vacuum. 
Resulting wave functional yields several minima of quark bilinears, 
giving masses of three (or more) generations. Mixing is suggested to 
be due to kink solutions of the same wave functional. For a special 
form of this mixing ("coherent mixing") a realistic hierarhy of masses 
and CKM coefficients is obtained and arguments in favor of the fourth 
generation are given. Possible important role of topological charges 
for CP violating phases and small masses of the first generation is 
stressed. 

PACS numbers: 12.15.Ff; 12.15.Hh; 12.60.Cn 

1 Introduction 



Despite spectacular success of the standard model (SM), the Higgs sector and 
the pattern of fermion masses and mixing remains mostly an unsolved issue, 
for the theoretical overview see [1]. In this paper we suggest a framework 
which might shed some light on the origin of generations, the hierarchy of 
fermion masses, and the Higgs problem. 

The topics mentioned above are related to several related problems: 
i) Dynamical origin of Higgs sector and spontaneous symmetry breaking 
in the SU{2) x U(l) sector; 
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ii) Fermion generations and hierarchy of fermion mass matrices; 
iv) Origin of CP violation. 

Possible solutions of the Higgs problem, different from the popular SUSY 
scenario, have been suggested by technicolor model [2] and by economical idea 
of top condensate [3,4,5], with a modern development of topcolor-assisted 
technicolor model [6]. There a strong interaction at high scale M ~ 10 15 — 
10 16 GeV allows to create Higgs sector dynamically, but leaves points ii) and 
iv) unsolved. 

A way to understand large top mass was suggested already 20 years ago 
[7] and developed in detailed manner since then [8,9]. The symmetry respon- 
sible for large top mass was called "flavour democracy" and considered in 
family space in each of the sectors (up, down and leptons) separately. The 
realization of this symmetry in the framework of the "flavor gauge theory" 
was given in [10]. 

The flavor-democratic scenario illustrates why in each of the sectors the 
mass of the third family is much larger than that in first two families and 
allows to connect phenomenologically the CKM mixing angles with masses 
[11]. However, it does not consider dynamical origin of first two families and 
another important hierarchy: why scales of the masses in three sectors are 
so much different, and inside the family the mass of top is much larger, than 
that of bottom and tau-lepton. 

Summarizing, the problem of lower generations was not addressed. It 
is remarkable that masses of the first generation have much smaller scale, 
which might signify that internal dynamics may differ from generation to 
generation. Also the dynamical mechanism producing generations remains 
unknown. It is a purpose of present paper to suggest a possible variant 
of such mechanism, based on nonperturbative dynamics of the EW gauge 
and fermion fields. We will show below that the fermion masses due to 
Spontaneous Symmetry Breaking (SSB) naturally form the family structure, 
when higher field correlators are taken into account. 

We also show that dilute topological charges in the EW vacuum may be 
responsible for the dynamics of the lowest fermion family. This formalism 
can be used for producing Higgs phenomenon in the same way as it was done 
in the topcolor-type models [31 HI [5j [6]. 

In this way the Higgs is coupled to (and made of ) all fermions, and 
the scalar condensate is formed dynamically, giving mass to all quarks. The 
field-theoretical framework allows to consider additional contributions from 
topological charges creating nonzero masses for light fermions of first gen- 
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eration. The fermion mixing is associated with the kink solutions of the 
same wave functional, which connect different stationary points correspond- 
ing to generations. For a special form of the mass matrix, called the coherent 
mixing form, the mass eigenvalues have a pronounced hierarchy and CKM 
mixing coefficients are expressed via the mass ratios yielding realistic values. 
The neutrino mass can be considered on the same ground, including leptons 
and quarks symmetrically, and then the mixing, both in quark and lepton 
sectors, is obtained in the same way. 

The plan of the paper is as follows. In Section 2 the gauge interaction 
at intermediate scale is introduced and resulting multifermion Lagrangian 
is derived. The gap equation is solved and the mass matrix is obtained 
and discussed in Section 3. Contributions of topological charges are given 
in Section 4. The problem of the fermion mixing is studied in Section 5, 
while the SSB and Higgs dynamics is presented is Section 6. Section 7 is 
devoted to a summary and possible developments of the method. Three 
Appendices contain an additional material for derivation of formulas in the 
text: Appendix 1 yields the quark Green's function in the field of topological 
charges; Appendices 2 and 3 describe diagonalization of the mass matrices 
in the case of three and four generations. 

2 Derivation of the mult i— fermion Lagrangian 

The SM Lagrangian can be split in two parts, 

LsM = Lgt + L Higgs, (1) 

where L st contains all kinetic parts of fermions and gauge bosons and their 
interaction, whereas Lm gg s refers to all terms where the Higgs field appears. 
It is our purpose, as in Refs. [3] [5], to derive Lm ggs with effective Higgs 
field from the fields present in L st , which would generate dynamically Higgs 
condensate, fermion masses, and mixings. 

To this end, first of all, we must organize fermions into some structures 
which enter the fundamental Lagrangian, namely, 

M^Kh A = {n,a}, 
where a = 1,2,3 refers to families and n = 1,2,3,4 refers to " sectors" of 



3 



fermions, which can be composed as follows 




Kr, "Zr, Kr) (2) 

= (en, Hr, t r ) (3) 
{d R , s R , b R ) (4) 



,rR a = (u c R,c R ,t R ) (5) 



Note that considering the gauge dynamics at high scale M, one can intro- 
duce, similarly to [11], the "urfermions" with quantum numbers which are 
possibly different from those of final diagonalized fermions in (2-5). 

Urfermions are denoted by the hat sign, ip^ an d supplied by an additional 
index a, implying that ip belongs to a representation of some gauge group G 
operating at the scale M. We shall assume here that this group is broken 
at low scale and only one, the lowest mass component a — 1, should be 
considered for low scale dynamics. The diagonalized form of ipa=i wm be 
associated with the physical states listed in (2-5). 

The destiny of higher states, V^a = 2,3.. will be discussed elsewhere, 
together with a possibility that the sets {a} and {A} have a common inter- 
section. In what follows we consider the simplest case with standard fermions 
listed in sectors (2-5). 

The fundamental Lagrangian at high scale reads ( the Euclidean fields 
and metrics are used everywhere) 

L high = gi A a (xh»c; b (x)$t(x), c; b = c;r: b . (6) 

The generating functional can be written as 

Z = const J D^C)DipD4>exp(i J 4>d$d 4 x + J d 4 xL high ), (7) 

where D^iC) is the integration over gauge field with the standard weight, 
which may be also considered as the averaging over vacuum fields C M , de- 
noted as (jF(C))c- In this way one can exploit the cluster expansion for 
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(exp(J L high d*x)), namely, 

(exp J L high d 4 x) = exp|y J 2 (xi, x 2 )(^(xi)^(x 2 ))dxidx 2 

+ J J±{x\i ..x^'${xi)...' i &{x4)dxi...dx± + ...| = 
= exp < Jn(xi, ...x n )^(x 1 )...^(x n )dx 1 ...dx n > . (8) 

[n=2,4,6,... J 

Here *ff(x) = ■0(x)7 M ^(x), and we have suppressed spinor and group indices. 
Note, that only connected correlators of field C M enter in J n . 

As a nesxt step, we do the Fierz transformation, which allows us to form 
white bilinears, e.g. for two operators 

{Tal^t ) = E cSto3*)$ B h OSt), (9) 

where q = —1, +1, |, ~ for i = S, P, V, A, and anticommutation of operators 
ip is taken into account. 

In a similar way one can make pairwise Fierz transformation for any n in 
(1H1), and keeping only 5* and P terms, one arrives at the combinations 

^(x l )^(x 2 ) -> $75$) $75$) - $$)($$) = 

= " {$*&)$£$*) + ($L^)(Ir$l)} (10) 

with the notation ®rl{xi,x 2 ) = ip R (xi)ip^(x 2 ). One can rewrite (jSJ) as 
follow^ 

(exp / L high d 4 x) c = expl- / 4(^1, --^n) 

[X(x 1 ,x 2 )X(x 3 , x 4 )...X(x„_i, x n )] dri...da; n } , (11) 



Note, that in general the expansion ([8]) is not gauge invariant. To make quark propa- 
gator S(x, y) and quark mass operator Mix, y) gauge invariant, one should consider quark 
accompanied by the parallel transporter y), i.e. tr[S(x, y)<fr(y, x)]. In case of confine- 
ment this precludes definition of one-particle dynamics. Here we consider nonconfining 
field C M (a;), and then one-particle operator M{x,y) can be made gauge invariant in the 
local limit, x — ► y. 

2 Note, that to form white bilinears in a connected correlator the number of fermion 
transmutations is always odd, hence, the minus sign in pip . 
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where X(x,y) = ® RL (x,y)$ LR (y,x) + ® LR (x, y)$ RL (y, x). 

At this point one can do a bozonization trick, which we perform intro- 
ducing functional representation of 5- function [12] . In short-hand notations 
one has^l 

(exp J L high d 4 x) c = J DfiDfi + DipDip + exp j-i J p(<p - $ RL )dx - i J /i + (v? + - ® LR )dx^ 
xexpi-^ f J n (ipip + + ip + ip) n/2 dx 1 ...dxA . (12) 

I n=l,4 J J 

Now one can integrate over Dip Dip in ([7]), since ip enters in (1121) only bilinearly 
in &lr- As a result Z in ([7]) acquires the form 

Z = const J DfiDu + DipD(p + exp(—i(fi(p) — i(fi + (p + ) + K{ii, (p}), (13) 
where the notations are used 

s - 1 = i a +i ^ +i ^ 75 (14) 



X 



V4 / /i(xi - x 2 )ip(x 1 - x 2 )d(x 1 - x 2 ) = 14 / Kp)y{p)j^rz ( 15 ) 



(2tt)< 

K{n, if} = -J2 [ Jn(w + + <p + <p) n/2 dx 1 ...dx n + trlnS- 1 . (16) 
As a next step we find the stationary points in integration over DfiDipDfj J + Dip + 



-^( x ) = T/ TT \ =Y, n [ Jn^ + (x)(ipip + +ip + ip) n/2 l 5{x l -x 2 -x) dXl ''f Xn 
-i<p{x)=tr{±{l + >y B )S}, -i v ,+(x)=*r{I(l-7b)5} (17) 



3 We have suppressed the SU(2) isospin subscript i in ^rli and below in </?j, ^?T, fi it ^f; 
in what follows we choose the gauge with tpi = 0,^ / 0. 
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and for /i + the same expression, as for /z, follows with the replacement ip <-> 
ip + . For the solutions of (IT7j) with /i = tp = p + one obtains for /i(p), y?(p), 
keeping only terms with n = 2, 4, 6, 



f dftq 

Mp) = 6 y J^Y J 2{<l)d{p -q)- 
d 4 qd 4 q' 'efts 



(2tt)< 



+ 6/ 



(2tt) 12 

d l qd t q'd i q"{Psd i s , J 6 (q, q', q", 0, 0)d(p - q)d{s)d{s + q)d{s')d{s' + q") 

(2^p ' 

(18) 

Here d(A) = 6 = 6 = 1, 6 = f. 

Eq.(18) is the main result of this section. Solutions n%{p) define the masses 
of different generations, i — 1, 2, 3, ... and will be the subject of study in the 
following sections. The composite scalar field (p and its nonlocal mass /J play 
the role of the corresponding Higgs parameters of the standard model. 



3 Qualitative analysis of the resulting equa- 
tion (US) 

At this point we specify the scales of nonperturbative correlators of gauge 
field and denote the correlation length of the correlators J n as M n , so 
that the average value of field C n ~ <J (Cfy ~ ^J(F^ U )M^ ; also for simplicity 
we assume that the correlation length does not depend on n, M n = M. 

Then one can introduce dimensionless quantities marked with tilde, jx{p) = 
f/,(p)/M, p = p/M, q = q/M etc., and dimensionless kernels J n 

J 2 = C 2 M~ 4 J 2 , J 4 = C i M~ 12 J A , J 6 = C e M~ 20 J 6 . (19) 

As a result Eq. (ITS]) keeps its form, where all quantities are now dimen- 
sionless (with the tilde sign), and 

6-6 = 6^7^, U^L = UCVM\ £ 6 = £ 6 (7 6 /M 6 . (20) 

Note, that the integration over momenta p, q is now over regions of the 
order of unity, while the mass eigenvalues p, = n/M are expected to be much 
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less than unity, /2(0) <C 1, and ji(p) decreases with p. Therefore d{k) = 
ji(k)/k, and one can extract p,(p) , jl(q) , ... from the integrals in (|T8"|) at some 
average point, /t(p*) — > //*. As a result one can approximate the integral 
equation ffT8l) by the algebraic one: 

H* = fi*a 2 - nla 4 + fila e - fila 8 + ... (21) 

Here a n are functions of /x*, a n (pf) = a n (0) + /i*a' n (0) + ... and for /i„ < 1 
one can keep only a n (0), which are the numbers proportional to (C /M^j . 
Three solutions of (12"T1) are readily obtained, when a n = 0, n > 8 



/^(1) = 0, M 2(2), ^(3) = 4 V - 61 2 L (22) 

To obtain \ii <C we assume that a 2 3> 4ag(ct2 — 1), obtaining in this way 

^(2) = ^, ^(3)^. (23) 

We further assume, that = v 2 <C 1 and — = v. Then masses of second 
and third generations are 

/i(2) = /i*(2)M = z,M, /i(3)^v^M, ^ ~ ■ ( 24 ) 

From experimental quark masses one has that v « 10~ 4 for (w, c, t) and 
f « 1CT 3 for (d, s, 6); parametrically z/ ~ , and M from (1241) turns out 

2 

to be M ~ — 1 ~ 20 TeV from the (w, c, i) sector. 

rrt2 v ' ' ' 

To make connection with previous results in top condensate- type models 
[3,4,5,6], one should neglect all a n except 02 (/i*), and returning to unsealed 
variables and identifying flavor-depending mass M AB = fi AB , writes 

Here g 2 = £ (J^j estimates the kernel J2, and cut-off at p ~ M is 
assumed. 

One can see, that Eq. (j2"5"l) is easily diagonalized in the flavor-democratic 
manner and one is facing the familiar fine-tuning problem [HE], where g 2 = 
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g 2 r + (m^/M 2 ). The ways to circumvent this problem are suggested in TC, 
ETC and TC2 models (see [SI 03] for a comprehensive review). However, 
in this Gaussian approximation (when only 02 is kept nonzero) it is not 
clear how to get three generations with distinct masses, different from flavor 
democratic scenario [8] |9| [TO]. 

As was shown above this can be done keeping nonzero three coefficients: 
02, 04, ci6 and this allows to obtain three generations with masses, which can 
be made much different by an appropriate choice of the coefficients 02, 04, clq. 
However, here the first generation acquires zero masses and to obtain realistic 
values of the masses new mechanism will be introduced in next Sections. 
A negative feature of the result (123"]) for /i(3) is that it depends only on 
the field correlators via 04, a 6 etc. and at this point two questions arise: 
why a 4 , ci6 etc. should be so much different, since the expansion parameter 

cannot be too large for realistic field configurations; also it is not clear 
why /i(3) is so much different for b and t quarks. In Section 5 we shall 
introduce a mechanism, which can in principle explain this high sensitivity 
of the quark masses and appearence of the realistic hierarchy of masses even 
if the coefficients Qjfi tire of the same order of magnitude. 



4 Topological charges in the EW vacuum 

In this section we demonstrate, that an admixture of topcharges in the EW 
vacuum can drastically change the masses of the lowest generation. 

At this point we would like to see the effects of topological charges 
(topcharges). We do not specify here the character of topcharges and its 
group assignment, assuming that in nonperturbative vacuum of field 
there are group-topological conditions for existence of corresponding solu- 
tions, similar to £77(2) instanton solutions. Therefore the fields of topcharges 
A$(x — Ri) in singular gauge, located at points Ri, have to be added to the 
fields 

N 

C,{x)^C,{x)+Y,Af{x-R % ). (26) 
i=i 

In this case the generating functional includes averaging over topcharge po- 
sitions, sizes and orientations, denoted as DQ, 

Z = const f DK(C)DnD^Dt/jexp{C} (27) 
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where £ = L\ + £ 2 + £3, and 



(28) 



£1 = ijip f dip f d 4 x; £ 2 = JipfC^ipfd^x, 
C 3 = El 1 f4> f A^(x-R i )iP f d i x 

Now we average over the fields C M as before, keeping topcharges intact, which 
brings in a new term, estimated at the stationary points, taking fi = p, + , one 
has 

£2^ J 4> f (x)i/j,(x,y)'ipf(y)d A xd' l y. (29) 

As a next step we average over topcharges in the same way, as it was done 
in case of instantons in [TH [T5l [16], see also Appendix 1. This yields the 
following quark Green's function (see Appendix 1 for derivation). 

OO -y 

S(x,y) = S (x,y) + J2u s (x)———uj(y), (30) 

s=l ^ 

where u s ,A s are the eigenfunction and the eigenvalue of the ensemble of 
topcharges, and So = (—id — ip)~ x and £ = — / ipS^ipd^x. 

Note, that in general the sum in (130]) contains Nq zero modes, correspond- 



ing to the net topcharge density and a region of quasizero modes. Ne- 
glecting correlations between topcharges, the eigenvalues follow the Wigner 
semicircle law in case of instantons [T5l [T6j . Going to the momentum space 
and averaging over topcharge positions, one has 

s<p) = ^— + ^ + (si) 

p — Z/I /I — l/J, 

where we have separated contributions of zero and quasizero modes and 
defined 



Qd(p) = *(P) = — ^— , » = {{r) J' (32) 

Here u (p),Ui(p) are zero and quasizero eigenfunctions; p is the average 

( v \l/4 

topcharge size, while R = ( ^ 1 is the mean distance between topcharges. 

To understand the change in the basic Eq. ffTBl due to topcharges and 
introducing d(p) = = p2 ^l , , one should compute 

dtr ! 
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Firstly, we simplify (l3"Tj) and take C\{p) = 0. In this case one has 



dtM = T^ 1718 ' 1 = + (coffiV (33) 

Since in (|33|) (p) ~ M, and //* = n/M, for the d-factor in (TL8]) in case 
of no topological charges onehasd* = dM pa //*, which produces Eq. (1211) . In 
case, when topological charges are present, i.e. (co 7^ 0), one has 

d,(topc h ar 9 e) = i~ ^ + „ „, + _^L_ (34) 

and Eq. lpTT) can be rewritten as 

/U* = a 2 d — a^d 3 + a 6 cP — ... (35) 

It is easy to see, that for /i* ^> y/c^ one recovers old result: d — > cf* ~ /i*, 
with two roots given in (|23|) . However, the zero solution for valid for Eq. 
( |2T|) . is not possible in Eq. (135]) . Instead, for //* < ^co, neglecting the terms 
a n , n > 4 in (1351) . one obtains one root, 



^W-^d^) 172 ' ^i^^M^v^M^^-) 174 . (36) 

Hence, the mass of the lowest generation is defined by the vacuum admix- 
ture of unbalanced zero models, i.e. by the topological charge of the vacuum. 
It is clear that higher order terms with 04,06,... contribute corrections to 
/i*(l), which are of the order of d^ 2 , cj 2 etc. and can be neglected. Thus in 
case of topcharges one obtains a new (and nonzero) solution /i*(l), while the 
masses of higher generations are kept intact. 

In the system (1351) there might be other solutions, in addition to three 
solutions (13"6"1) and (123"j) . which are of the order of M^J~^, M^J^ etc. However, 

with discussed above assumptions, < 1, ^ < 1, these roots appear to 
be higher than the scale M and therefore unphysical. Other and smaller 
roots could appear, if ^ <C Co, ^ <C Co etc., which do not seem reasonable 
for realistic c < 1CT 8 . 

One more general remark is in order. As shown in Appendix 1, the 
approximation used in ( l30j) . when fi enters in the denominator of second term, 
is valid when the correlation length of the vacuum M~ l is much smaller than 
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the size of topcharge p, M _1 <C p. Then one can consider (nonlocal) effective 
mass p as a constant inside the topcharge field. It is clear, that in general 
the high-n correlator term J n (xi, ...x n ) will be outside of topcharge size p 
for high enough n, hence, zero mode contribution (second term in (134"|) ) will 
be effectively damped in high-n terms a n d n — > a n p™. Therefore one cannot 
expect additional roots from higher a n d n terms, which are not present in the 
a n p™ series ( 12T1) . Hence we except, that topcharges can create small masses 
of the lowest generation, with the scale proportional to the concentration of 
topcharges. 

5 Mixing due to fermion bilinear condensa- 
tion. The mechanism of coherent mixing 

Till now we have disregarded the matrix nature of pik, (fiik- As it is clear 

from (!9!)- (Tl2l . <&rl(x\,X2) = ^r^i^l ( x 2) is a matrix in the indices A = 
(n, a), B = (n', (3), where n, n' refer to families and a, (3 to fermion sectors. 
As will be shown below,the sector mixing in a,f3 does not occur from the 
effective Lagrangian K{p,ip}, Eq. (flBT) . but the family mixing does occur. 
For notational convenience in the matrices p nn >, <£W, instead of n, n' we shall 
denote the family numbers i, k as pik, ifiik, i,k — 1,2,3, and use the 
relation 

V-ikijp) = (P 2 + fi 2 )imk{p), d ik (p) = (f ik {p)- (37) 

Then the basic equation (TIB]) can be rewritten in the x-space as (for \p 2 {j>) \ 
P 2 ), 

-□ <p(x) = - 5 4M- = Jrf - + - (38) 
bip(x) 

where J n are actually nonlocal kernels in x-space corresponding to the p-space 
kernels in (18). Also the functional U{(p} can be written as 

um = ~\-hf + -M A - \~hf + - (39) 

2 4 o 

Our functional U{(p}, Eq. ( 1391) has the standard form which was already 
investigated in the local limit in search for solitonic solutions [TTJ, [18] . As was 
discussed above, U {if} has several stationary points, which we associate with 
the p-space solutions of Eq. (fl8l) or the x-space solutions, of Eq. (|38l) . These 
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solutions are not like solitons, but rather solutions of nonlinear nonlocal 
integral (or integro-differential) equation, where the values of tp ik are varying 
in the region around the stationary point (p n {x) of U{0}. Therefore one can 
identify the diagonal elements of the matrix function (p{x) with ip n (x) as 
follows 

<Pik(x) = 5 in 5 kn cp n (x), n = 1,2,3,... (40) 

Let us now turn to nondiagonal elements of 0ik{x). /,From physical point 
of view, since the diagonal elements are associated with stationary points 
of U{(p}, nondiagonal elements (pij should be solutions connecting two sta- 
tionary points i,j, i.e. solutions of kink type. A well-known example of 
the kink for the functional U(<p) = |(y3 2 — m 2 /\) 2 is given by the solution 

0kink{x) = ^th (jjl=(x — xq)\ which connects stationary points (p\ — ^7= 
and 02 = Therefore we shall assume here, that similar solutions exist 

in our case for Eq. fl38|) with the value of (fik(x)(i ^ k) varying in the region 
between stationary "points" ^p n (x) with n = i and n = k. 

Now coming back to qualitative discussion (in Section 3) of possible solu- 
tions n{p) of Eq. ( Tl8l) or <fik(x) of Eq.( l38|) . one expects the average fermion 
masses fakip) ~^ fak to be equal to /z(n) for i = k = n, and some average of 
and /i(fc) for i ^ k. In what follows we take ^ for the kink solution as 
the "geometrical average" 



fak = V ^{i)^{k) (41) 

and in this case the spectrum with all eigenvalues, with an exception of the 
largest one, appear to be arbitrarily small. We call this phenomenon the 
Coherent Mixing Mechanism (CMM). 

To study qualitatively the CMM in more simple case of two families, we 
start with the mass matrix ^ both in up and down sectors: 

»* = (u T)- (42) 

\ fa2 fa J 

The eigenvalues of nn- in the case with /i 2 \i\ are 

m + = u 2 H , m_ = ui . (43) 

fa fa 

For the choice (IHjl and \iyi = Jfafa, one has m_ = 0, m + = fii + /x 2 and 
the CKM matrix Vik has the form 



V = W u Wt = _ 2 ' - n2 (44) 




13 



with i] = , which refer to the sector (d, s, b), since (u, c, t) sector yields 

much smaller if). It is clear, that varying /X12 around the value ^/xi/j^, one 
obtains physical values of m-i in the region from u.\ to zero, and hence /xi can 
be Hi > ma, while /x 2 ~ m + ~ m s , and r\ has a reasonable value , 77 « 0.2, in 
agreement with experimental data. Note, that in CMM the choice (T4TI) gives 
the maximal value of mixing for fixed /xi, /x 2 and minimal value of m_ = 0. 

For three or more generations one can write the general CMM matrix fx 
as follows^ 

\ 

, Ak = fMfJ-k{l+Vik)- (45) 

/ 

Here we denote a diagonal effective mass fin as /x^; it corresponds to the 
i-th minimum of the functional U(0), and then consider 77^ small, \rjif. | <C 10. 

We assume that /xi < /x 2 < /x 3 < ... and /i; not necessarily much smaller 
than /x i+1 . 

The eigenvalue equation in case of tree generations, det(/x — ml) = 0, 
given in Appendix 2, Eq. (1A2.3l) . can be written as 

m 3 - m 2 a + m£ - ( = (46) 

where coefficients can be expanded in powers of r] ik , yielding a = J2i fa, £ — 

- Ei# fa^jVij, C = fafaiVs (-| Ei^j Vij + \ Hi+j i^k VijVik) ■ Since m x m 2 m z = 
(, for very small ( the lowest eigenvalue mi tends to zero, and one obtains 
the following hierarchy of eigenvalues 

C £ 

nil — — , m 2 ~ — ; m 3 ~ °"- (47) 

Note, that one can easily adjust the strong hierarchy, namely, m x <C m 2 <C 
m 3 by a simple variation of the parameters 77^ . For example, as shown in 
Appendix 2 for the choice 77 23 = 7/13 = —77, 7712 = —5, < 5 <C 77, one has 

mi^/x^, m 2 » — (/xi + /x 2 )t7, m 3 « /xi + /x 2 + /x 3 - (48) 
m 3 

4 Our input mass matrix contains fii,/j,ik, and the final diagonalized mass matrix con- 
tains physical masses rrii, i = 1,2,3 (m Ul m Cl m t and ma, m Sl rrib). 

5 Note, that for ^ — fi , (i = 1,2, 3) and rjik = one recovers the " ultrademocratic" 
mass matrix [7] -[9]. 



/ Hi {J>12 fa3 
/Xi2 /X2 /^23 
/^13 ^23 ^3 

V 
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It is interesting, that for 5 rj 1 the CMM has made the hierarchy much 
more pronounced, than original situation with /ix < // 2 < ^3, and m 1; m 2 can 
be made very close to zero, while 777.3 is not far from /X3. 

The mass matrix (|45p is diagonalized, as shown in Appendix 2, with the 
help of the unitary matrix W, Eq. (lA2.13j) . where we also introduced imag- 



inary parts in as fiik = \^ik\^ l5lk to account for a possible CP violation 
with the condition 5 12 — #13 + <5 2 3 = 0. A very convenient way of constructing 
unitary matrices W in terms of ^ and m 8 was given in [18]. There a simpli- 
fied form was obtained in case W\% 0. In our specific case of CMM matrix 
( 145]) . the element W31 tends to zero when 5 — > 0, and another simple form 
for W, shown in (1A2. 15[) . occurs. The resulting CKM matrix V is readily 
computed from W u and W d Eq. (jA2.15ft and it is given in the Appendix 2, 
Eq. flA2.17j) . It is expressed in terms of the phases 5ik and the values rrii, ^ 



only. The latter enter via sines and cosines defined in flA2.16j) 



Using (A2.17) we can write a simplified version of CKM matrix realizing, 
that all cosine factors are equal to unity within (1 + 2)%, while the sine 
factors ~ 0.1, and one has the following estimates from PDG 



Vud\ = \c u a c d a + sXe 4Al2 1 = 0.97418 ± 0.00027 (49) 



|\4s| = \s u a e i5 ™ - s d a e iS ™\ = 0.2255 ± 0.0019 (50) 



V cd \ S \s d a e- iS ™ - s u a e- l5 ^ \ = 0.230 ±0.011 (51) 



\Vcs\ = K$<£4 + 0(ss)\ = 1.04 ± 0.06 (52) 



\V tb \ = \$c d +0(ss)\> 0.74 (53) 

\V ub \ = \s u a {s}e i5 ^ - s Je i{ ^+ 5 23))| = (3.93 ± 0.36)10~ 3 (54) 

\V cb \ = \s u e iS ™ - s d p e iS ™\ = (4.12 ± 0.11)10" 2 (55) 

\V ts \ = \s d p e- lS ™ - s}e- i5 ™\ = (3.87±0.23)10~ 2 (56) 

\V td \ = \ s d a (s d e- lS ^ - s u p e- l(S ™ +s &) \ = (8.1 ± 0.6)10~ 3 . (57) 
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One can see, that two equalities arise from the above expressions 



v us = -v; d , v ts = -v; b (58) 

The experimental values for moduli of these expressions are equal within 
the errors. 

The angles a, /3, 7 are easily computed from the entries of fH9|) - fl57|) . 
namely: 

a = A 12> (3 = aig(s d a -s u Q e-^), T = 7r-A 12 -/3. (59) 



Assuming a ~ \ [19], our prediction is /3 = 24°, yielding sin 2(3 = 0.73 not 
far from experiment. 

Moreover, dividing ([51]) by f[5"oT) and using the condition 5 Vi — 5 i2 = <5 2 3, 
one obtains = 0.1, which yields p u ~ 20 MeV, whereas dividing V td ( ISTjl 
by (|56|) . one obtains ~ 0.21, which defines //^ ~ 10 MeV (both at the scale 
of 2 GeV). An important check is the reparametrization -invariant quantity 
p + if] = — y d y* , which in our simplified ansatz flA2.15j) is 



P + *i= 7\o2.r^2 ~ 0.18 + zO.38. 

The assumption A 23 = makes possible a strong cancellation in (si — 
Sge~ A23 ) ~ (s^ — Sfl) which should be as small as 0.04, yielding p s w 0.35 
GeV, /i c ~ 14 GeV. Using fT49l) - fl5TI) one has a reasonable estimate for J, Eqs. 
(IA2.18I) . (IA2.19I) . if and s u p satisfy §1D, 



J = stst\s d p - s^e iA23 | 2 sin A 12 w 3.2 • 10" 5 sin A 12 , 



which agrees well with the PDG value [19]. Thus all phenomenological tests 
are passed by our representation. 

At this point one could estimate more systematically the input values of 
Pik necessary to satisfy experimental data for V^. We shall not do it here and 
in the next Section we present the arguments, that this procedure is better 
to be used in case of four generations. 

In Appendix 3 we explain that in CMM the eigenvalues of four generations 
obey the same pattern as in the case of three generations - with a steady 
highest mass and volatile lower masses. 
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6 Spontaneous symmetry breaking, the Higgs 
condensate, and the fourth generation 



The fermion bilinear condensation discussed above plays the same role in 
the EW spontaneous symmetry breaking, as the standard Higgs mechanism, 
and in this sense is an extension of the topcondensate mechanism to the case 
of many generations. Since there are many condensates , {<pij) and (</?«), 
one might worry about multiple composite Higgs bosons and in this Section 
we shall study the situation with the Higgs condensate (and hence with the 
W and Z masses) and the scalar excitation of the condensate ("the mass of 
Higgs boson"). 

To obtain the Higgs condensate, one can use the Pagels-Stokar relation 
[20] . where the whole spectrum of quarks in the quark loop diagrams for the 
scalar current is introduced. In the leading order it gives 

2 N c ^ 2 M 
4tt 2 Y M») 

where v = 246 GeV is the standard value of the Higgs condensate, and the 
sum is over all quark masses in n generations. With the hierarchy al- 
ready known for three generations and assumed for four generations, the 
dominant contribution comes from the highest mass max = yU maX ; and 
from flBDl) /i max for a given M can be estimated. The results are given in the 
Table. 



For Myy and Mz one has the standard relations 

M^ = ^v 2 i M|cos 2 9vk = "jv 2 . (61) 

Table. The values of highest quark masses for different mass scales M 
from Eq. (l60]) - in second row, and from [2T]-in bottom row. 



M 

GeV 


10 19 


10 17 


10 13 


10 9 


10 5 


10 4 


5- 10 3 


/'max 

GeV 


143 


153 


180 


228 


377 


518 


616 


/'max 

GeV 


253 


259 


279 


316 


446 


591 
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Note, that f[6"Ul) is a naive approximation with //(z) as a constant, which 
does not depend on momenta of loop integration. Taking that into account 
one obtains much higher values of /i max for a given M [21] ( see Table), 
hence, /i max cannot be associated with the top quark mass (at least in this 
approximation). For more discussion see the review by Cvetic [5] and Refs. 
therein. 

For M smaller than 5 • 10 3 GeV the Eq. flBUj) is not a good approximation 
and one should use a function fj,i(p) as in Eq. (ITS]) , however, the consistency 
of the whole approach is questionable for /i max ~ M. Therefore we onsider 
Z^max ~ 0.5 -T- 0.6 TeV as the maximal value of the t' mass, and it is clear that 
t' mass should belong to the 4th generation of quarks. 

As we noted in Section 5, the CMM ensures volatility of the masses of 
all lower generations, while for the highest generation the masses are rather 
stable. This picture is consistent with what should happen to the masses of 
the 3d generation, when there exists the fourth generation. Indeed, mt> ~ 
0(4 GeV) and m t « 0(180 GeV) are very different, and might be seen as a 
subject to large changes, when small changes in the mixing coefficients rjik 
in Eq. (|45|) are made. In this way assuming existence of four generations one 
might resolve the old problem in the top condensate mechanism. 

It is remarkable, that the analysis of precision data in [22j for my = m t > = 
300 GeV and the mass of heavy charged lepton = 200 GeV shows the 
same \ 2 minimum for four generations as for three, supporting in this way 
the idea of the fourth generation. Note also, that for degenerate b' and t' 
quarks the mass of each of them is roughly by (35 -j- 40%) less than shown 
in the Table. For discussion of the possible parameter space of the fourth 
generation see [23J. 

Let us now discuss the topic of the possible (composite) Higgs boson 
mass. It is clear, that the induced Higgs Lagrangian should have the same 
form as in the topcondensate case, where the Higgs field h is the deflection 
from the stationary point i = j of the effective potential h = H — v = fin — v 

V(H) = —m 2 H H + H + ^{H + Hf + ^(H + H) 3 + ... - (^ m H + h.c). (62) 

The difference from the standard topcondensate case is that i) there only 
one minimum of V(H) exists at H — v, while in our case at least three minima 
should be present; ii) higher order terms in h are present already at the tree 
level, e.g. 74 (tree) 7^ due to higher correlator terms J n ,n > 4 , while for 
the topcondensate case (only J 2 present) these terms are induced by fermion 
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loop diagrams. Moreover the higher correlator terms contribute dominantly 
to the coefficient of h 2 /2 (the Higgs mass) in the situation discussed in Section 
3 (e.g. a6 > a4 > ai etc.). Hence, we can conclude that in this case the 
lowest Higgs mass appears for the largest minimum, i.e. near \ia = fi max . 
Then (also neglecting admixture of lower minima) all coefficients are mostly 
quark loop- induced and hence, rxiuiggs — 2/z max , as well known [20J, [I]. In 
our favored case of four generatons, it means that the Higgs mass is around 1 
TeV (for M ~ 10 4 - 10 5 GeV). As noted in [22], this situation of high Higgs 
mass and one extra generation does not contradict precision data. 

One should also have in mind, that this Higgs boson is not elementary 
and, if it exists at all, can be associated with an excited unstable qq state. 
For more discussion of the new physics with Higgs and the fourth generation 
see [21]. 



7 Conclusions and outlook 

Results of the paper are threefold. First of all, we present a possible dy- 
namical scheme of qq pair condensation which might explain the generation 
structure of the fermion hierarchy. 

Secondly, we have found in the same scheme a possible source of fermion 
mixing, identifying it with the kink-type (soliton-type) solutions of the same 
effective potential. 

Finally, we have suggested a new type of mixing pattern, called the co- 
herent mixing mechanism (CMM), which follows from two first solutions. In 
this way one obtains a simple parametrization of the CKM matrix V: in 
terms of two phases and the input masses //j (corresponding to minima of 
effective potential), and resulting physical masses wij. 

In CMM strong mass shifts {jh— rrii) of all lower generations are caused by 
tiny changes in mixing parameters, which may explain large mass differences 
in u and d sectors. The same volatility in the masses for the third generation 
and experimental values of strongly prefer the scheme of four generations 
with m t i ~ my ~ 0(300^-500 GeVjj. In this case also the Higgs condensate 
and W, Z masses are correctly reproduced. The method of the paper allows 
to predict more explicitly the resulting masses m t ^my and some mixing 
coefficients, which is planned for future publications. 

6 Four generations were found favorable also in the context of flavor democracy scenario 
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As an additional possibility the role of topcharges in the EW vacuum 
is studied and shown to be effective in producing very small masses of the 
first generation; also the origin of the CP-violating phases can be directly 
connected to the topcharge contents of the EW and GUT vacuum, as was 
suggested before in [26J in another framework. 
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Appendix 1 

The quark Greens's function in presence of topological 
charges 

One starts with the gauge field of the form 

N 

C u (x) = B u (x) + Y / ^: ) (x) (Al.l) 
i=i 

where B u are nontopological fields, while Ay (x) are fields of topcharges, ex- 
act form of those is not important for us, but we shall assume that topcharges 
form a dilute gas with no correlations. Our goal is the calculation of the full 
quark Green's function S in the field C u (x), 

S= (-id-gB-gJ2A^ (A1.2) 
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in terms of individual topcharge Green's functions Si = (—id — gB — gA^') 1 
and S = (-id - gB)- 1 . 

One can use the same technic as exploited in the Faddeev-type decom- 
position of the Green's function for particle scattering on many centers [re- 
introducing t- matrices, t j = So — Si and amplitudes for scattering Q^, where 
i refers to the first and k - to the last scattering center, one has equations 
for Q ik _^ 

Qik = ti5ik — tiS J^Qj'fc- (Al.3) 

For Si one can use the spectral representation 



Si(x,y) = 



tff(s)tff+(y) 

(») ■ : 
fin — im 



(MA) 



where we have introduced the quark mass m for future convenience, and 
v$(x) satisfies equation 



lu(dn - igB u - igA^'{x))u^{x) = fi^u^'[x) 



Using ( 1A1.4I) one can rewrite ( 1A1.3I) as follows 

u^(x)u^ + (y) 



(A1.5) 



Qik(x,y) = $ik 



So(x,y) - 



(*) 

fih, — im 



+ 



n fin - im 

Solving (IA1.6I) for Q ik , one immediately finds S 

N 

S = So — ^ Qik- 



id - gB - $)Y,Qjk(z iy ). 



(A1.6) 



(A1.7) 



Lk=l 



One can represent Qik as follows 



n / \ ^(x)R^ n ,ut) + (y) 

mk\x, y) — 2^ , (t) . w (*:) .x 

n,n' (fJm - im)(jl n / - ITTl) 



(A1.8) 



and for i ^ k, Eq. flA1.6j) reduces to (in matrix notations for upper and lower 
indices) 

R = £R, (A1.9) 
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where we have defined 

Ju®(z)(-iB-gB-$)v$(z)#z 



Snn' 



yik 
nn' 



(k) 

— im 



(k) ■ ' 
fi y n / — im 



i^k (ALIO) 



while by definition £™ , = 0. Introducing notation 



im)(fi^} - im) I u ( ^ >+ (x)S (x } y)u ( ^(y)dxdy - (fi® - im)8, 



(0/ 



JO = ,.(*) 



for R u one obtains 

nn Inn' ' Smm mn' ' 

One can rewrite (1A1 .9|) . fl Al . 12[) as 



nn' ; 



R = r) + £R, R 



1 



7/. 



(Al.ll) 
(A1.12) 



(A1.13) 



Denoting £ = V" ^_* m , one can write finally S 1 in (lA1.7j) as 



5(x,y) = 5 (x,y)+ 2 «S 



(<)/ 



1 



ik,nn'n" 



(Note, that = /i® 5 ik 5 nn ') . 

Neglecting the second term in the square brackets in (lA1.14j) 
reasonable for zero and quasizero eigenvalues fi n ), one can write 



(A1.14) 
(which is 



ik 



S(x,y) = S (x,y)+ £ «g>(x) 



nS )+ (y) (A1.15) 



ik,nn' 



One can find the eigenvalues As of the operator fi — imV, and eigenfunctions 
w s (x), and result (1A1.15I) turn out to be 



S(x,y) = S Q (x,y) +J2 u s( x )- 



1 



- u t(y) 



' A s — im s 

and u s (x) are collectivized eigenfunctions of the gas of top charges 



(A1.16) 



1 



U- 



1 



ft — im — V A — im 



U + ; u s (x) = U s , in uf(x) 



(A1.17) 
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For the zero net topcharge in the volume V4 (with, say, periodic boundary 
conditions and top charges in the singular gauge) there are no global zero 
modes, and only quasizero modes, which e.g. for dilute gas of instantons of 
size p, have the Wigner semicircle distribution [151 EE] 

u(A) = -L(2W 2 - A 2 ) 1/2 6(2W 2 - A 2 ), (A1.18) 

where the averaged value in the QCD instantonic vacuum [16] V 2 ~ O (^j , 

V 2 = k ~ 0.14 GeV. 

In case with nonzero global topcharge Q, one obtains Nq zero modes with 
A s = in the sum (1A1.16I) . and the sum (1A1.16I) is singular for m — > 0. This 
fact is exploited in Section 4 to exemplify the new mechanism for creation 
small fermion masses. 



Appendix 2 

Diagonalization of the mass matrix and the CKM parametriza- 
tion 

One can write the incident mass matrix obtained from the minima of 
wave functional ({TBI) as 

' Mi M12 //is \ 

V = fi U \l2 ^23 ( A2 -l) 
V /il3 ^23 ^3 / 

and we shall test our assumption that nondiagonal elements /i^ due to kink 
solutions are close to "geometrical averages" of minima fii and fij, (Coherent 
Mixing Mechanism (CMM), namely 

(iy = fiifij + A i:j = Hiiij{\ + %•)■ (A2.2) 

The eigenvalue equation for flA2.1j) looks like 



(lii -m) (/i 2 -m) (p3-m) +2/ii 3 /ii2yU 2 3-/i? 3 (a*2 -m) -f4 2 {^-m) {ji x -m) = 

(A2.3) 
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We assume that the input masses /ij satisfy either condition I 

Hi < fi2 < H3, (A2.4) 

or more stringent condition II: 

Mi < n 2 < /is- (A2.5) 
Eq. (1A2.3D with the use of (1A2.2I) can be expanded in powers of rjy = 

m 3 - mV + - C = 0, (A2.6) 

where a = Ei /ij, £ = - Ei^j A -, C = Hi^^{~\ Ei^j Vij + \ J2ij,ik VijVik)- 
Since we have connections between roots m, and a, £, £, namely, 

mim 2 m 3 = (; ^mjrnj = £; ^! m » = ff (A2.7) 

one can associate £ with the smallest root mi, then putting ( = 0, one 
obtains from (IA2.6I) mi = and for m-2,m 3 one has the equation 

m 2 - ma + £ = (A2.8) 

with the solutions: 



a 4. r 2 t t + £ 2 _u n 

m= ± \/X - ^ m 2 = - + - + 0. , 5 

2 V 4 a cr 5 \ V cr° 

m 3 = a -^ + o(^Pj . (A2.9) 
To the first order in £ one obtains 

mi = — , m 2 = -,m 3 = a (A2.10) 
m2m 3 a 



and conditions m 8 > yield £ > 0, £ > 0. Using (IA2.4I) or flA2.5j) one can 
estimate 

C £ 

mi = -, m 2 ^ — , m 3 « // 3 + /x 2 + A*i- (A2.ll) 

? /i3 

Thus we conclude that due to mixing the mass m 3 does not move signif- 
icantly from /i 3 , while the masses mi,m 2 can drastically decrease. 
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It is interesting to find out how the ratios of m, may change, when 
or rjik are changing, i.e. we are interested in the motion of the eigenvalues 
rrii when mixing parameters Aj^,^ are changing with \n fixed. To this end 
we keep two of r/ik equal, e.g. r/23 = ^13 = — V < 0, and 7/i 2 = —8, \8\ <C rj. In 
this case we have ( = Hi^^sV^ £ = ^3(^1 + H2), and 



mi 



Hi + A*2 



8 Hi, 



m 2 = - 
a 



VH3(Hi + H2) , mi 
' m 2 



5 



MlA*2 



*7 (Mi + M2) 2 

(A2.12) 

Thus one can see that — can be much smaller than ^ for 8 <C 77, while mi 
can be made arbitrarily smaller than fix, and m 2 much smaller than /i 2 for 
small enough 5 and r](8 <C 77). 

Let us now turn to the unitary matrix W, which diagonalizes the mass 
matrix (1A2.1|) . At this point we can exploit the results of recent paper [18], 
where matrices W u , Wd are given for any form of the matrix (1A2.1|) . 

To make our analysis more general, in (1A2.1I) we introduce also phases 
for matrix elements Hik- arg/ij/s = 5?.fc, ik = 12,13,23 with the condition 
^12 — ^13+^23 = 0; then the matrices which diagonalize the matrix Hik with the 
eigenvalues mi < m 2 < m 3 (so that ft = W + rhW), can be readily written, 
using the general form of the unitary matrix from [18] . 



W 



( (M2-r»l)(M3-"li)-|^23| 2 M13M23~^12(W~ m 2) M12M23 ~Ml3 (jfg ~"l 3 ) \ 

' Ni ' N2 ' N 3 

IJ^S^23^ia0^Zl^ll (Atl-m 2 )(M3-m 2 )~|Ml3| 2 Ml 2 Ml3-M23(A'l-'-"3) 

Ni ' N2 ' ^3 



V 



/ 



^12^23-^13(^2-^1) Ml2Mi 3 -M23(Ml- m 2) (^l-m 3 )(^ 2 -m 3 )-|/Ji2| 2 

ATi ' 7V 2 ' 7V 3 

(A2.13) 

Here we have used the notations similar to those from 1181. 



= (777,3 - mi)(m 2 - mi)[(/i 2 - - mi) 



iV 2 2 



|A*23 I 

1 21 



(m 3 - m 2 )(m 2 - mi)[(// 3 - m 2 )(m 2 - /ii) + | /x 13 1 ] (A2.14) 

A 7 ! = (m 3 - m 2 )(m 3 - mi)[(m 3 - /ii)(m 3 - // 2 ) - | /x 12 1 2 ] . 

For the case of CMM the masses mi ~ H18, m 2 ~ (hi + /i 2 )7/, m 3 ~ 
Hi + /^2 + /^3, < 5 <C 77 < 1, and one can estimate W31 in the limit 



5 



0. 



(mi 



0), W, 



31 « -I 



^ A M^ A /^. One can use this limit, 

m 3 V M1+M2 y us v ' 
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5 — > 0, to simplify considerably the matrix W, as it is done in [TB] if W13 = 0. 
In our case W has the same form as obtained in [18j for W + , so that in our 
notations we can write as3 



W 



~S syC 



-idi2 _ 



where we have denoted 



C a Cf3 



, c a s p e 



(A2.15) 



m 2 - Hi 



1 - 4, C /3 



m 3 - /j, 2 



S/9 



1 - r 2 
1 Cg. 



m 2 -m 1 v V 2m 3 - /i 2 - H3 

(A2.16) 

Note, that the matrix (lA2.15j) contains 4 independent parameters: s Q , 
and two phases 5^, as it should be for the 3x3 unitary matrix. This form of 
W, W + is assumed both for u and d sectors and the entries will be denoted 
as Cq, s™, Cg, and the same for d. As a result one can construct the CKM 
matrix V C km = W u Wj~. 

Writing Vqkm = {Vik}, one has for matrix elements. 

T/ _ n u d 1 u d u d AA12 _i_ u it d d iAi3 



Vi 



12 — ^ Q c a c aS3 



V 13 = s^cge*^ - sj^eW^ 



^21 = -to" 



+ c « c «cgs£ e -^ + cXs^i^e^ - *^ 



(A2.17) 



T/ nn _ „« d -iA 12 , u u d d , u J « JJA23 



T/ _ „«„d « «<5£, u u d iSi, 



T/ _ n u d a d -i5( 3 d u d -i6%„-i8( 2 



7 Note that the form (j A2. 15|) does not contain the terms 0(?y), 0{8), which are present 
in (|A2.13|> . 
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^32 = 



^33 - SgS^e + CgCg. 

Here notation is used Ajfc = — <5f fc . 

One can also easily calculate the Jarlskog invariant J, 

J = Im(V 23 V* 3 V^V 31 ) (A2.18) 

Using ( 1A2.17I) one can write the leading term (eg ~ c a — 1, Sp -C 1, s a <C 1) 
in the form 

J = sls d a \s d p - sy A23 \ 2 sin A 12 (A2.19) 



Appendix 3 

Coherent mixing in four generations 

Here at first we simplify the problem, neglecting the phases 5y in the 
4x4 mass matrix , taken in the form (j4"5j) . and define the eigenvalues rrii,i = 
1, 2, 3, 4 from the quartic equation 

m 4 — aim 3 + a 2 m 2 — a 3 m + a 4 = 0, (A3.1) 

where the coefficients aj can be expressed either via the eigenvalues: 

4 4 4 

a i = E m *' a 2 = E a>3 = E m i m j m k, a 4 = IJmi, (A3. 2) 



or through the mass matrix coefficients: /i^j = /iifc = y f^i^k(^ + Vik)- Ex- 
panding to the lowest power of r/jfc, one obtains 

4 

fll = E ^ fl 2 = - E Vi^kVik- (A3. 3) 

4 4 1 /l 1 \ 

«3 = n ^ e — e ( - 7^ ) • ( A3 - 4 ) 

i=l n =l i^Jjkn VZ 1 / 
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a4 = 2f[/ i M ^VikVkiVii- VikVkiVis+ VijVikl = (A3. 5) 

4 1=1 {i^k^l i^s+k+l ijkjjkljLk J 

1 4 

= 7 II A*! {^12^13^23 + ?7l 4 (^23 ~ ^13?723 ~ W723) + 
4 i=l 

^24(^3 - 7?12?7l3 - ^13^23) + ^34(^2 - ^12^13 - ?7l2^23) + 
^23(^14 - 7?14?724 - ^14^734 + ^34^24) + ^{vli ~ ^24^34 ~ ?7l4??24 + r] M 7] 1A ) + 

+??12(^34 - ^14^734 - ^24^734 + r/24^14)} • (A3. 6) 

In the last form (1A3.6I) the terms are ordered according to the power of 
7]^, which can tend to zero. 

To simplify coefficients and establish a connection with the case of 3 
generations, we assume that only three new elements are nonzero in the 
4x4 fiik as compared to 3 x 3 fiik, namely, 7/4,7734 = ^24 = — fj, fj > in 
addition to considered before 7/13 = r/23 = —7), f]\2 = —8. 

Then to the lowest order one has 

a 2 = fMifaS + A*3(A*i + + 7/4(7/2 + ^3)77. (A3. 7) 

11 77 

a 3 = /Ui/i2/i3^-^/^i^2/i4(5-^) 2 -^A i i/i3A i 4(^-^) 2 +/i 2 /i3/^4?7(^-^), (A3.8) 

3 4 

a 4 = - JJ liiSrpj. (A3. 9) 

4 i=i 

In the case, when fj > ? and /i4 > /i3 > 7/2 > all coefficients a iy i = 
1, 2, 3, 4 are positive, yielding positive eigenvalues mj. In the limit (5 — > 0, ?y — > 
both 03, 04 vanish and for two largest eigenvalues one has 



m 4 ,m 3 = y ±W-- o 2 , (A3. 10) 

^4*7 A / A o 1 1 \ 

m 4 = tr , <r = 2^ //i, (A3. 11) 

i=l 

m 3 = . (A3. 12) 
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Thus again, as in the case of three generations, the largest mass is 
slightly larger than // 4 , whereas m 3 pa 77/J3 can be strongly shifted from the 
input value /13. For mi, m 2 one obtain an estimate 



m 2 



«3 



«3 twiiv 



m 3 m A ?7/i3/i4 



»7 



mi 



a 4 



(A3.13) 

Now we have to find the unitary matrix W, which diagonalizes the 4x4 
matrix ^ik] for that we impose two conditions 

W + W = l, W* ki W kl = 5 u (A3.14) 



W + mW = ft, 



(A3.15) 



where m = diag. (mi, 777.2, rn.3, 777.4). 

In CMM the simplest (4 x 4) form which is a natural extension of the 
(3 x 3) matrix (IA3.15P is 



W 



-1612 



0. 



—C a Cp, 

spe- iS ™, 



V 0, 0, 

The phases 5^ satisfy conditions 

"24 — "23 + O34, O14 = (5i3 + £34 



c A s a Sf3e lSl3 , 
c 4 Sf3C a e lS23 , 
C4C/3, 

-s 4 e- i<534 , 



s A sps a e iS ^ \ 



S4S f)C a € 

s 4 Cf3e i5s4 
c 4 



i(524 



5l4 — 5' 



21 



5 



12- 



(A3.16) 



(A3.17) 



One can notice that only two of these conditions are independent of the 
old, 3x3 condition <5 12 — £13 + ^23 = 0. Here s\ + c| = 1, so that in (1A3.16P 
one has two new parameters, e.g. s 4 and <5 34 . 

One can check, that the unitarity condition of W, Eq. flA3.14j) . is satisfied, 
while ( IA3.15j) yields approximately 



/i 4 

/^3 



2 1 2 2 1 

c 4 m 4 + s 4 Cgm 3 + ... 
2 1 2 2 1 

7B 4 S 4 + 7713^0^ + ... 



(A3.18) 



m 2 s 2 a + mi4. 



/j, 2 = m 3 s f3 + m 2} Hi 

From ( 1A3.18I) one can see that /i 4 < m 4 and /ij > , i 
relations (1A3.lltiA3.13j) are approximately satisfied. 

From (IA3.15P one can find c a , Cg, c 4 (sj 



1, 2, 3 and the 



1 - cf , i 



a,/3,4): 



m 2 - /ii 
m 2 — 



m 3 - \i 2 



m 3 + Hi - mi - m 2 



/i 4 - m 3 + \x 2 
m 4 - m 3 + jj 2 ' 



(A3.19) 
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